Modular definition of multimodal ECA communication acts to improve dialogue robustness and depth of intention

نویسندگان

  • Alvaro Hernández
  • Beatriz López
  • David Pardo
  • Raúl Santos
  • Luis Hernández
  • José Relaño
  • Ma Carmen Rodríguez
چکیده

In this paper we propose a modular structure to define communication acts with verbal and nonverbal elements inspired in the SAIBA model. Our modular structure is a conceptual interpretation of the functional features of a multimodal interaction platform we have developed, with an embodied conversational agent (ECA) that implements verbal and gestural communication strategies aimed at minimising robustness and fluency problems that are typically encountered in spoken language dialogue systems (SLDSs). We conclude that it is useful to add a pre-verbal level on top of the FML-BML scheme in the SAIBA framework, and we propose a category extension for FML to account for communication elements that have to do with the speaker’s non-declared intentions.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Langage de conversation multimodal pour agent conversationnel animé

This article falls within the realm of dialogue between a human and an Embodied Conversational Agent (ECA). We claim that a specific agent conversational language is needed for such interactions, based on the essential role of emotion in human communication. In order to define this language, we propose a library of Multimodal Conversation Acts is proposed, based in particular on speech acts and...

متن کامل

A Reasoning Module to Select ECA's Communicative Intention

In the context of a ECA-human interaction, we propose to create a BDI-like reasoning engine based on the agent’s beliefs. This reasoning engine first aims to trigger the agent’s emotions from its goals, beliefs, ideals and the notion of responsibility. Then this engine selects the agent’s communicative intention from its mental states and a set of dialogue rules. The integration of “Stimulus Ev...

متن کامل

Modeling Lateral Communication in Holonic Multi Agent Systems

Agents, in a multi agent system, communicate with each other through the process of exchanging messages which is called dialogue. Multi agent organization is generally used to optimize agents’ communications. Holonic organization demonstrates a self-similar recursive and hierarchical structure in which each holon may include some other holons. In a holonic system, lateral communication occurs b...

متن کامل

Construction of Dialogue among couples in Yazd : Towards a Grounded Theory

Introduction: Considering the importance of Constructive communication among families; The present study has studied and explained the understanding and experience of dialogue among couples in families in Yazd. Method: In this study, a qualitative approach and grounded theory method and Purposive and theoretical sampling were used and 31 couples from normal families in Yazd were selected and ...

متن کامل

Expressive Multimodal Conversational Acts for SAIBA Agents

We discuss here the need to define what we call an agent conversational language, a language for Embodied Conversational Agents (ECA) to have conversations with a human. We propose a set of Expressive Multimodal Conversation Acts (EMCA), which is based on the Expressive Speech Acts that we introduced in a previous work, enriched with the multimodal expression of the emotions linked to these act...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008